An Immersive Telepresence System using RGB-D Sensors and Head Mounted Display

摘要

We present a tele-immersive system that enables people to interact with eachother in a virtual world using body gestures in addition to verbalcommunication. Beyond the obvious applications, including general onlineconversations and gaming, we hypothesize that our proposed system would beparticularly beneficial to education by offering rich visual contents andinteractivity. One distinct feature is the integration of egocentric poserecognition that allows participants to use their gestures to demonstrate andmanipulate virtual objects simultaneously. This functionality enables theinstructor to ef- fectively and efficiently explain and illustrate complexconcepts or sophisticated problems in an intuitive manner. The highlyinteractive and flexible environment can capture and sustain more studentattention than the traditional classroom setting and, thus, delivers acompelling experience to the students. Our main focus here is to investigatepossible solutions for the system design and implementation and devisestrategies for fast, efficient computation suitable for visual data processingand network transmission. We describe the technique and experiments in detailsand provide quantitative performance results, demonstrating our system can berun comfortably and reliably for different application scenarios. Ourpreliminary results are promising and demonstrate the potential for morecompelling directions in cyberlearning.